The Hopfield Model
نویسنده
چکیده
In this note, I review some basic properties of the Hopfield model. I closely follow Chapter 2 of Herz, Krogh & Palmer (1991) which is an excellent introductory textbook on the theory of neural networks. I motivate the mean field analysis of the stochastic Hopfield model slightly differently than Herz, Krogh & Palmer (1991) and my derivations are a little longer, filling in some of the gaps in the original text, to make them more accessible to the beginners.
منابع مشابه
محاسبه ظرفیت شبکه عصبی هاپفیلد و ارائه روش عملی افزایش حجم حافظه
The capacity of the Hopfield model has been considered as an imortant parameter in using this model. In this paper, the Hopfield neural network is modeled as a Shannon Channel and an upperbound to its capacity is found. For achieving maximum memory, we focus on the training algorithm of the network, and prove that the capacity of the network is bounded by the maximum number of the ortho...
متن کاملEstimation of Network Reliability for a Fully Connected Network with Unreliable Nodes and Unreliable Edges using Neuro Optimization
In this paper it is tried to estimate the reliability of a fully connected network of some unreliable nodes and unreliable connections (edges) between them. The proliferation of electronic messaging has been witnessed during the last few years. The acute problem of node failure and connection failure is frequently encountered in communication through various types of networks. We know that a ne...
متن کاملNon-monotonic Hopfield Networks
We investigate the retrieval phase diagrams of an asynchronous fully-connected attractor network with non-monotonic transfer function by means of a mean-field approximation. We find for the noiseless zero-temperature case that this non-monotonic Hopfield network can store more patterns than a network with monotonic transfer function investigated by Amit et al. Properties of retrieval phase diag...
متن کاملGeneralization in the Hopfield Model
In the Hopfield model the ability of the network to generalization is studied in the case of the network trained by one input image (the standard).
متن کاملAlternative Dynamic Network Structures for Non-linear System Modelling- Camera ready
Hopfield Neural Networks have been used as universal identifiers of non-linear systems, because of their inherent dynamic properties. However the design decision of the number of neurons in the Hopfield network is not easy to make, in order for the network model to have the necessary complexity, extra neurons are required. This poses a problem since the role of the states that these neurons rep...
متن کامل